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ABSTRACT 


In the early 1980’s John J. Hopfield developed a 
recurrent network based on a model of biological neurons. In 
his model, each neuron accepts inputs from all other neurons 
in the network, modifies each input with a weight and converts 
their sum to an output via the non-linear sigmoid transfer 
Pinel lon. This output is then fed back to each of the input 
paths where the input signals are updated before the next 
summation. It has been proposed that this network can be 
successfully applied to the problem of system parameter 
identification where the weights are functions of the system 
states and the network, after being allowed to process a 
continuous block of system states, 1S guaranteed to converge 
to the system parameters. This thesis explores the concepts of 
network stability and solution existence for a time-invariant 
system. It is shown that the network will converge as expected 
provided the steady-state solution falls within the range of 
values of the sigmoid transfer function. Experimentation with 
the network when not all system states are measurable revealed 
that knowledge of the actual system parameters is necessary ee, 
obtain convergence because of large error between the actual 
and estimated system states, showing that minimization of this 
error must take place before the network 1s integrated. 
Pamaily;, -1t 318 shown that as system parameters vary, the 
Hopfield network will track the parameter changes provided the 


system remains persistently excited by the input. 
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I. INTRODUCTION 


A. BACKGROUND OF THE NPS AUV II PROJECT 

The Naval Postgraduate School’s Autonomous Underwater 
Vehicle II (NPS AUV II) supports the second generation of 
projects focusing on the development of an unmanned, 
untethered vehicle possesSing sufficient, self-contained 
intelligence to perform a broad range of missions while being 
able to respond to unplanned situations and take appropriate 
meerons. The project is part of the U.S. Navy’s ongoing 
studies of unmanned, sub-surface, marine vehicles and their 
usefulness in an expanded role in the future Navy. As 
described in Healey et al., [Ref. 1], the NPS AUV II is the 
imac OL i1tS kind to attempt a Mission Planning Expert System 
which will serve as a framework within which all of the 
vehicle’s logical operations and resulting actions will be 
Garried out. 

The vehicle’s missions might consist of any of the sSub- 
Surface tasks currently being conducted by manned Surface and 
sub-surface vehicles and by free-swimming personnel. It would 
be required to successfully navigate within a prescribed 
Operating area while avoiding all stationary and moving 
obstacles but at the same time completely Surveying any 


@ejects which meet the "Special interest" criteria of its 


mission planning system. Its mission would also inci. 
Storing and analyzing data before deciding future courses of 
action appropriate to its mission and be capable of eventually 
down-loading all such data for human analysis. Unplanned 
Situations might encompass sudden changes in the vehicle’s 
operating environment such as shifts in current direction and 
speed, the sudden presence of belligerent animals or vehicles, 
faults in its own logic or operating systems, or errors iii 
mission program (1.e., incorrect navigation information 
The capabilities of such a vehicle are far removed from 
those of any Similar platform in use today. Such a vehi@ier 
NPS AUV II must ultimately possess complete "knowledge" of its 
own operational abilities, similar to what humans refer to as 
"motor skills," while at the same time be able to "think" 
about various responses and courses of action and decide which 
would best suit the goals of its mission. Such capability jam. 
the numbingly vast array of possibilities it entails, can not 
possibly be programmed into a computer as a series of tasks. 
The prospect of a so-called "thinking machine" 1S Nol Somme. 
fetched, however, and this is where the theory of Artificial 


Neural Networks (ANN) may eventually find application. 


B. ARTIFICIAL NEURAL NETWORKS 
The origin of ANN may be traced back to as early as 1943, 
when McCulloch and Pitts wrote their landmark paper "A Logical 


Calculus of Ideas Immanent in Nervous Activity" [Ref. 2]. 


Since then scientists, engineers, physicists, and biologists 
have been studying ways to mathematically model the human 
brain’s ability to accept inputs from many, completely 
different types of sensors, analyze that data, decide on a 
@euese “OF action, trigger the proper response in its 
operational appendages, and learn from the results of that 
response. The focus of the research efforts in the field has 
been centered on a mathematical relationship called a neuron, 
akin to the biological brain cell of the same name, whose 
output is a weighted summation of the inputs from other 
neurons and which is then used either as an input to other 
neurons or as part of the output of the network as a whole. 
Mecreimportantly, for application to "thinking machines,” the 
output of any particular neuron can be used in a feedback loop 
Pommodiiy the weights associated with its own inputs. This 
type of network, known as "recurrent," shows a minimal ability 
to "learn" that a particular pattern of inputs produces a 
corresponding series of outputs based on the values of the 
input weights, marginally like the functioning of short-term 


memory in humans. 


C. ANN AND NPS AUV II 

In examining the need for NPS AUV II to "know" its own 
capabilities and limitations and the usefulness of ANN in 
"learning" a pattern associated with a particular input 


environment, a connection can be made with neural networks for 


diagnostics [Ref. 3] and system parameter identification 
[Ref. 4]. It has been proposed that a Hopfield network [Ref.5] 
[Ref. 6] can be configured in continuous time to accept a time 
history of the state-space response of a dynamic system 


represented by the equation 
xX =Ax+Bu (1) 
where xX 1S a vector of state variables, x is ES aie 


derivative, and u is the system input, and identify the system 
parameters represented by the matrices A and B. System 
parameter identification provides the vehicle with its own 
blueprint for input-output response upon which it will base 
its decisions regarding the proper actions needed to effect 
desired results. By continuously updating its own database as 
system parameters change, such events as internal faults or 
external, environmental limitations can be detected and 
diagnosed. 

The focus of this thesis is on exploring the method of 
Shoureshi and Chu [Ref. 4] to determine if it might, indeed, 
be useful for vehicle system parameter identification in real 
time. The next chapter provides a brief history of ANN, 
focusing on the Hopfield recurrent network and how it is 
adapted by Shoureshi and Chu Ee system parameter 
identification. Chapter III presents the results of stability 
investigations of the Hopfield network formulation and the 


speed of convergence to expected solution values. Chapter IV 


delves into study of the use of full-state and reduced-order 
observers with the Hopfield network to determine if the 
network will correctly identify system parameters when not all 
System states are measurable. Chapter V is a study of the 
Geieity fOr Ene “network bo track the ‘pattern of -system 
parameters as they vary with time. Finally, in Chapter VI a 
summary of the strengths and limitations of Hopfield networks 
and recommendations for future research in related fields are 


presented. 


II. PARAMETER IDENTIFICATION AND HOPFIELD NETWORKS 


Pi. INTRODUCTION 

This chapter begins with a brief history of the stwayae. 
ANN and presents an overview of the first ANN algorithms, 
which continue to provide a foundation for current research, 
Emphasis is placed on the development and theory of Hopfield 
networks, not only because the Hopfield model is the basis for 
the research in this thesis, but because it also helped infuse 
the flagging ANN research community with new energy in the 
early 1980’s. Much more detailed analyses of the entire 
history and scope of ANN research, including that which has 
been conducted since Hopfield’s efforts in 1982-1984, Came 
found throughout Wasserman [Ref. 7] and NeuralWare [Ref. 8]. 
Those references also serve to guide the history and 


background Informal lou 4 Ens sense eew. 


B. HISTORY OF ANN 

As mentioned in Chapter I the impetus for the study of 
mathematical models for brain activity began with McCulloch 
and Pitts in 1943. Their subsequent work focused on the neuron 
model shown in Figure 1, reprinted from Wasserman [Refi .)/iiee 
28], which shows the neuron modeled as a summation of several 
weighted inputs. The result of the summation is then compared 


to some threshold value: if the threshold is exceecdea™ the 


Figure 1. Single Perceptron Network 


output is 1; otherwise it is 0. This basic System, wages 
became the foundation on which the first generation of ANN was 


built, is represented mathematically as 


N 
1, if }°W,x, > THRESHOLD 


i=1 


V= (2) 
N 
0, if }>W,x, < THRESHOLD 


i=] 


In the 1950’s and 1960’s this Simple system was greatly 
expanded into multi-layered networks, with variations being 
applied to such diverse fields as pattern classification 
(Rosenblatt [{Ref. 9]), Signal filtering (Widrow (Ret. agg 
and macroscopic intelligence (Mimsky [Ref. 11]). Al jaueg 
applications were based on a learning rule proposed by Hebb 
(Ref. 12] which assumes a multi-layered network where neurons 
are interconnected as well as available to receive and 
transmit external inputs and outputs. Basically, where two 
neurons, represented by subscripts 1 and j, are connected to 
each other and to other neurons in the network, the value of 
the weighted connection is adjusted based on the values, or 


"excitation levels," of the two neurons. In equation form, 


W,.(t+1) =W,,(t) +00, (3) 
where W,, = the weight of connection from i to j 
O, = the excitation level of neuron i 
O, = the excitation level of neuron j 


The weights are increased, and the connections strengthened, 


each time the vector of inputs produces excitation levels for 


both i and j equal to the binary value 1. As each successive 
WeeceOor OL Eraining inputs is applied, a pattern of weight 
values emerges where often-used paths are strengthened well 
eeeo7e ene wWevels of Jittle-used paths. Provided the training 
data is ot Sut ie rent quantity, tela ys pattern will 
theoretically produce a desired vector of output values 
equivalent to those of the training sets and the network can 
be said to have learned the correct response to a given input. 

In subsequent uses of Hebbian learning, the manner in 
which the products of the two excitation levels is obtained 
has been altered through various functions. Wasserman [Ref. 
Papp. 29-100] uses the term “activation function" to describe 
a class of functions where V=F(Q). The function F may be a 


Simple threshold function where 


1, if O> THRESHOLD 
V= (4) 
0, if O< THRESHOLD 


and THRESHOLD is some constant value. Later variations have 
modeled F as a simple linear function with or without some 
Gain multiplier, while more recent forms have sought to 
emumate the actual activity of a biological neuron. This last 
(aire ures prominently im the work of Hopfield (Ref. 5) 
[Ref. 6] and will be the subject of extensive discussion in 
Peerion & Of Ehis Chapter. 

The claims that the proponents of ANN were making 


BegGarcding the wsefulness and. wide application of their 


algorithms led Minsky to apply rigid mathematical tests to the 
theory of "perceptrons," a term coined by Rosenblatt [Ref. 9] 
to describe his variation of the McCulloch-Pitts alocorvenmeawes 
their book Perceptrons [Ref. 11] Minsky and Papert proved that 
the perceptron algorithm was not able to solve the Simple, 
"exclusive-or" (XOR) problem, which is linearly inseparable. 
A detailed analysis of this shortcoming is presented by 
Wasserman [Ref. 7:pp. 29-33], who represents the XOR problem 
in tabular form for a perceptron consisting of one neuron and 
two inputs, designated x and y. Table I is reproduced here, 
where the values of x and y are binary and the output, O, 
follows the XOR rule. 


TABLE I. THE "EXCLUSIVE-OR" PROBLEM 
ee ee 


x y V 
0 0 0 
iL 0 i 
0 1 1 
1 1 0 


The equation for the summation of the neuron inputs is 
© = xw, + yw, (5) 


where the output V of the neuron takes the form of Equation 
(4) where THRESHOLD can be any constant value between 0 andl. 
Minsky proved that there is no set of weights, w, and w,, that 


will completely duplicate Table I, regardless of the threshold 


10 


value. This revelation, among others, proved a heavy blow to 
mie Stucy Of ANN “ana greatly contributed to the dearth of 


research in the field throughout the 1970’s. 


c. HOPFIELD’ S CONTRIBUTION 

Though limited work on ANN continued following Minsky’s 
book, the field was fully revived in 1982 after a presentation 
by John J. Hopfield to the National Academy of Sciences in 
1982 (Ref. 5]. Hopfield began with the system formulation 
proposed by McCulloch and Pitts, where the basic network 
consists of a set of neurons which compute the weighted sum of 
the inputs, then set the output to zero or one depending on 
their relation to a set threshold value. What made the 
Hopfield network unique, however, is the fact that the output 
of each neuron is fed back to the inputs of all other neurons. 
(In the original formulation, Hopfield believed a neuron could 
not be fed back to itself. This has since been abandoned as a 
condition.) An example of this “recurrent” network is shown in 
Fem@uere 7, reprinted from’ Wasserman {Ref. 7:p.: 95]. The 


activity of a neuron is represented as 
N 
_ 6 
0. NE aes (6) 


where the neuron output 


1, if ©, > THRESHOLD. 
Vv.= ; i (7) 
+ 0 it Of THRESHOMD: 


ili 


Figure 2. Typical Recurrent Network 


LZ 


Equation (6) 1S an expanded version of the original algorithm, 
where I. is an external bias input. This form of the equation, 
and others that follow, appear in a subsequent paper presented 
by Hopfield to the National Academy of Sciences [Ref. 6]. The 
basic Hopfield learning rule, contrasted with that of Hebb, is 
NON 
Nips) dypD (20 ea eCauee 1) ‘ek 
AW. = AW... 
In Equation (8), V. are values at a k** iteration level in the 
Eeciming (learning) process and AW; updates Wyytrom k to k+l 
as k oo, It can be seen that the connection weights increase 
when the output of a neuron is the same as the input but the 


weight values decrease when the input and output differ. 


D. THE ISSUE OF STABILITY 

A major question which arose regarding the recurrent 
Merrtela network was that of stability. This clearly had not 
been a problem with perceptrons because of their feed-forward, 
static architecture. With the Hopfield net, however, a proof 
was needed that the network would converge to a stable state 
GOmea! | inputs. Building on work by Cohen and Grossberg (Rer.: 
13], Hopfield theorized that his model followed the activity 


of the bounded energy function represented by 


1 N N N N 
E = ey 2 WY, =» big Dy gV. (9) 


dlge 


where g is a set threshold value, I, is a bias, and the energy 
of the network must decrease or remain the same as it changes 
State. Thus, the change in energy due to a change in the value 


of the neuron state V. is 
N 
AE = -AV, bs Wi lesa) (10) 


It can be seen that the sign of the expression in the brackets 
is inversely proportional to the change in energy E. 


Substituting Equation (6) into EPouaer cm (ie anes 


j= 


AF, = -AV, bz O,-9, | (ia) 


or, if ©, is greater than the threshold g,, the bracketed vauie 
iS positive and the output of neuron 1 muSt Change ine 
positive direction or remain constant. This means that AV, can 
only be positive or zero, so AE must be negative, or E is 
decreasing. If O < g,, the bracketed value is negative and AV, 
must be negative or zero so again AE must be negative. 
Finally, if © = 9,, AE is zero and EH remains constant. Somme. 
under all conditions E is either decreasing or unchanged, this 
function, which is bounded, must eventually reach some bounded 
minimum value, proving the eventual stability of the network 


Siac Sr 
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E. THE CONTINUOUS HOPFIELD MODEL 

Having proven that his discrete-state model was stable 
MmGaer all veonaitions, Hopfield sought to expand) the model to 
cover continuous systems, which represented a more realistic 
application [Ref. 6]. The original model, where the change in 
states of a neuron is represented by a binary "on-off" firing, 
was retained for the continuous formulation. However, Hopfield 
noted that actual state changes were non-linear and lagged the 
outputs of other neurons from which its inputs were fed. He 
modeled this characteristic as a simple RC circuit, with input 
Capacitance C, neuron resistance R, and the impedance between 
the output of neuron j and input of neuron 1 designated W,.. 


J aoe 


da e} 
-=y)wv.- 


ae +I (12) 
dee Se 


Ry: 


~~ 


iC 


where 


OG wy) (13) 


The input-output relation represented by the function g. is 


Giemmon=linear “sigmoid” function 


i 
(QO) = (14) 
Bee) UEC 
where A is the learning rate, a coefficient which determines 
the slope of the linear portion of the sigmoid function. 


Picgure ss its a plot of the, function for A=0.1. 
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For the purposes of determining stability the energy 


function from Equation (9) now becomes 


V 


a N N N il : a N 
B= “dy dy MiNi + 2 - J Daves re IV. (15) 


The derivative with respect to time is 





N N 
dE — dV. lx © (16) 
Pa — z W. V.- +I. 
dt D at » ce ‘ 
PuoseirPuting BQuatitOns (12) and (13) into Equation (16), 
N 8, 
dE -V dv, 17 
————— CeG.. V. aes ( ) 
at » uc | 


pumee oO. (Vj) 1S a monotonically increasing function and Cy is 
positive, then all terms in the right-hand side of Equation 
(17) are positive and dE/dt is negative. If dE/dt = 0, this 
implies that dav,/dt = 0 and the neuron is not changing state, 
SO a minimum energy has been reached. Hopfield’s stability 
proof, however, is not too convincing as the energy function 
in this case is not necessarily bounded and can, under 


circumstances to be shown, diverge. 


F. THE HOPFIELD NETWORK FOR PARAMETER IDENTIFICATION 
Hopfield’s method of modelling his network as the 

minimization of an energy function was adapted by Shoureshi 

BuGmeliue( Retr. 4)"for suse in minimizing the equation error for 


Scr ciVerparameter” 1dentLitication. “This .has  -frar-reaching 


se 


application to the control system field because having full 
knowledge of a system’s dynamics in the form of parameter 
identification is essential for stable control, and leads to 
adaptive systems if parameters change. 

The state-space form of any continuous SyStemiee 


represented by 


RE) SAG Sue) 1 
y(t) =Cx(t) ee 


where x(t) 18 a vector of system variables, 6, Stacec mea 


is their time derivative vector, u(t) is some vector of time- 
varying inputs to the system, and y(t) is a vector of 
measurable outputs from the system response. The coefficients 
A, B, and C, are matrices which define the physical 
characteristics of the system. These matrices may depend on 
time, but will be modeled here as time-invariant. The equation 
error associated with incorrect estimates of the parameters 


when u(t), X(t), and x(t) ane fully “meascuned mieecomes 


é(t) =x(t) -Ax(t) -Bu(t) (19) 


The goal of successful system identification is to minimize 
the error between the estimated and actual system parameters. 
A convenient method is to minimize a positive-definite 
function defined as the square of the equation error of Jem 


system. Such a function might be 
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JT=trl[E lé(t)-é/ (t)}) (20) 
feito OF Lhe Lame-varlance Of e(t), expected values are used 


Memrormilate J, and the trace of the matrix of error values is 
taken as an average of the total error. Thus, after 


SMescetitution of Equation (19) into (20) 


J=E (VW! (HH) V - 2V/H’& + &/x | (21) 
where 
H=diag ix’ (t),u’. (t)}, i=l,n; He Rex Perr) (22) 
and 
Viieale yh een DS iaeee cary ioe (23) 


ema@ea,, 6, are the it? rows of A and B. 

A conceptual and mathematical similarity between J and the 
emeroy function FE of Hopfield’s papers can now be seen. The 
Poemnt 1S to minimize the error function J to produce a least- 
meibaees CGuation error of the continuous control system, much 
as Hopfield showed that his network minimized the energy 
mmerion &E. Furthermore, identification of the proper system 
Pomeameters requires that minimization of J be conducted with 
mespect to the vector of neuron outputs V. Calculating that 


partial derivative yields 


Og 


= -E(H’3 24 
as E { (H/H)V})-E {H's} (24) 


i 


At this point, a direct connection is made between the state- 
space form of the system dynamics and the Hopfield model. 
Equating Equation (25) with Equation (12) and assuming R, 92% 
aie C,— iy 


OJ _ do. Ls - 
+ Phe ly (25) 


Now, 1n comparing Equations (25) and (24) it can be seen that 


W=-E((H/H)} I=E { (H’x)} (26) 


The secret of system parameter identification using the 
Hopfield model is revealed by Equation (23) to be the steady- 
State solution of the network. Further, the performance index 
gradient in Equation (24) is contained in the time derivative 
dO/dt . 

Though the association between the adaptation of the 
Hopfield network for system parameter identification and 
Hopfield’s own proof of the minimization of a bounded energy 
function has been shown, it can not yet be said that stability 
for the new formulation has been proven. This proof is 
contained in Appendix A and is based on showing the 
minimization of the positive-definite function J. The e22-. 
shows that the time derivative of J is always negative and 
therefore J will always seek a minimum value. 

It 1S now clear that to use the Hopfield model for system 
parameter identification, one must collect all of the Stage 


variables of the system response, as well as the input, and 
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use them to formulate the Hopfield weight matrix W and bias 
matrix I. Then, one need solve the system of first-order ODE’s 
@epseuarion (25) for Ehe vector V. The solution obtained for 
V will, by definition, be a vector containing the elements of 
the A and B matrices of the state-space form of the system, 
and system parameter identification will be achieved. 

Preoure 4 is a block diagram showing this process. The 
"Averaging System" is a routine which accepts the time history 
of the system input and its state-space responses and 
formulates matrices W and I averaged over a certain time 
interval. This process was developed as a result of knowledge 
gained from experimentation and is explained in greater detail 
in the next chapter. The bias matrix I is added to the 
negative product of the weight matrix W and the vector of 
Previous Neuron outputs V. This sum 1S multiplied by a scale 
factor "sl" to speed the response of the system and the result 
is a time derivative which, when integrated, yields a vector 
of the weighted summation of inputs from all other neurons. 
This vector is operated on by the non-linear activation 
Tomer rOl, G FO Produce the eurpul of The current neuron. 

tiie tollowingo chapters in Enis Ehesis present che results 
of extensive experimentation with the theory of system 
parameter identification using the Hopfield network. Using a 
Best Case fOr a simple, time-invariant, second-order system 
where the response and the parameters are known, the Hopfield 


model is implemented in computer software to solve the 


Za 






AVERAGING 
SYSTEM 


x(t) x(t) u(t) 


Figure 4. Block Diagram of Continuous Hopfield Network 


id. 


ehearactervsttc System) oft first-order ODEs. Experiments are 
Semauctea using both linear and non-linear threshold functions 
Speed wee assue of Stability cf *the network is thorouchly 
explored. As an attempt at a more realistic scenario, the 
performance of the network is evaluated when the system 
response 1S not completely known, that is, not all state 
variables are measurable. Finally, in a case that would most 
certainly arise in the operating environment of NPS AUV II, 
parameter identification accuracy is evaluated when the 


parameters themselves change with time. 
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III. RESULTS OF THE HOPFIELD SIMULATION 


A. INTRODUCTION 

In this thesis, the theory of Shoureshi and Chu [Repaeeg@ 
using the Hopfield algorithm for parameter identification has 
been applied to a known, second-order system herein referred 
to as the "test case." This test case is the same as that 
investigated in [Ref. 4] but the solutions have been found 
completely independently. The purpose of this exercise is to 
investigate the important aspects of the Hopfield algorithm as 
related to global stability, speed of convergence, most 
efficient formulation, and accuracy in identifying ies 
parameters. This chapter provides a detailed analysis of this 
test case and results of the Hopfield formulations using both 
linear and non-linear transfer functions, the non-linear 


function being exclusively the so-called "Sigmoid” fumGemaiae 


B. LINEAR TRANSFER FUNCTION 
The test case system chosen is an oscillatory , second- 


order system with both states excited by the input signal, 


u(t). The matrices of constant parameters are 
é = O9AZA See oo a alhe" (27) 
=12, 566 =. 9aZ45 270 
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The equations for the system in state-space form are written 


as follows: 


x. x. (28) 


where u=Sin(t) is the system input. This input function was 
chosen to produce persistent, system excitation. Figure 5 is 
a plot of the state variable response of this system along 
Meee eae Mpc UW fOr tnitial conditions arbitrarily chosen as 
Reel? il. 

Appendix B contains the computer code for this problem 
formulation, implemented using MATLAB software. The first step 
in the main program, called "neu," obtains an appropriate time 
history for the two state variables and their time derivatives 
from which the weight and bias matrices, W and I, are formed. 
This step is necessary because this approach to system 


identification requires measurement of x, &, andu. For this, 


meawimgeakUeea Second-— and third-order numerical intlegrator, 
provided by the MATLAB software, generates response data for 
the system of two, FErse- order, Sraitarys (Ot rrerent ied 
equations (ODE) making up the state-space formulation. The 
Subroutine "system" contains the state-space equations where 
A is the dynamics matrix and B is the gain matrix. The MATLAB 
BON odie MeEeCGraArLOr, a Subroutine Called “odeZz3," operates on 


these equations given the time interval specified by "to" and 


ZS 


Variable Response 


Test Case System, State 


xi,x2,u 





Time (sec) 


Figure 5. Test Case System, State Variable Response 


Zio 


Bete srainasDy Tne. lntel al Cconacttions "xo" > For Ehis Tormalarion 
Pom. 0, jer=l-O; and xo=-(1°1]. Subroutine "odeZz3" chooses non- 
constant time intervals based on the speed of convergence of 
MPiewsOllitons and returns the values of £, x-, and x,. 

A loop in the main program reintroduces these values for 


Ie 


Bait A 


Pooler ss, INES the. subroutine “system” “to obtain ime 
corresponding time derivatives of x, and x,, designated f, and 
f,. The input u=sin(t) is calculated given the time steps 
provided by "ode23." Program "neu" formulates the matrices W 


Memes ON tic E1me Miskor1es Of x,,-Xs;/-2 X,7 aieru,»> a's 


Xo 
presented previously. As the main program was first written, 
W and I were formulated for each time step, but this quickly 
proved to be unworkable as W is a singular matrix for each 


Gime step. As such, W° does not exist, so the steady state 


Solution 
Viecine S (29) 


likewise does not exist. 

To investigate this problem further, W was formulated as 
the average for each time interval of state variable 
measurement and the upper singular values (usv) of the 
eigenvalue pairs were calculated and plotted. Figure 6 is a 
plot of the usv’s of the eigenvalues of W versus the number of 
time steps used to formulate W before averaging the elements 
fo obtain a final W. Each curve shows a pair of singular 


walues (the matrix is symmetric) and it can be Seen that until 
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the number of averaging steps exceeds 30, one pair of 
eigenvalues is too close to zero to ensure the stability of 
the network solution. From this point on, 50 was taken as the 
appropriate number of time steps over which to average W. An 
optimization of this problem was not attempted but might be a 
Subject of future research. To check that this was an 
acceptable formulation for W, the steady-state solution for 
the system parameters, Equation (29), was calculated for each 
time step of the state-space response. Figure 7 shows a plot 
of this steady state solution and it can be seen, as expected 
when the input signal is free of noise, that within three time 
steps the proper ©,, is returned. Note that in the figure, as 
in the computer code, © is denoted "th." 

Once the proper number of averaging steps was determined, 
it was necessary to reset the vectors for t and x» to contain 
only that number of elements. The main program, as currently 
written, cycles these re-sized vectors through the subroutine 
"system" to obtain their corresponding time derivatives in the 
Matrix £. With this information the matrices W and I. are 
hOommibrarea by multiplying these column vectors of x, £, and wu 
as specified to produce each individual element, which in turn 
is divided by 50. What results is a 6X6 weight matrix W and a 
Gxtebias Matrix EI which are averaged for the system state over 
melgmily the first one second of time. 

Subroutine “hop2" contains the Hopfield algorithm and 


Comprises the next phase of the computer code. Program “neu” 
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Figure 7. 


SO 


calls "hop2," entering with W and I and integrating the series 
pa biGct-oreger, ODE’ Ss tO produce a solution contained in 


the vector ©. As before, the equations of the system are 
de. 6 6 
— =) Was * 2, (30) 


The linearity of this particular system lies in V, which for 


this first test case is represented by: 
v=© (31) 


A scale factor, s1=50, multiplies W and I to increase the 
BesPonse Speed. 

Program "neu" uses a Simple Euler integration, where it 
was determined by experimentation that dt=.02 produced 
acceptable convergence of the solution to the final values of 
© provided integration was carried out over 100 steps. As will 
bewadiscussed in the section on non-linear transfer functions, 
ieewas Giscovereaq that the actual, desired solution for the 
system parameters is returned in V, not ©. This was overlooked 
Seeeirce Decause Of the constraint imposed by Equation (31), 
which essentially means that there was a unit transfer 
function for the linear case. 

Figure 8 shows a plot of each individual element of 9 
Mormmalized with respect to the actual system parameters versus 
Mmiewnien-camensilonalized time of Buler integration. It can be 
seen that all elements converge to the expected values within 


Mer=20. Figure 9 is a plot of the normalized © vector and 
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shows that convergence to the actual system parameter vector 


©, occurs within ®,t=15. 


C. NON-LINEAR, SIGMOID, TRANSFER FUNCTION 

The case where the Hopfield network was implemented using 
a linear transfer function has been thoroughly investigated. 
It has proven useful for the purposes of exploring the 
important aspects of stability associated with this problem. 
In addition, the linearity of the system guarantees that a 
solution will be obtained provided Wis not Singular. The non- 
Singularity of W is ensured by averaging over an appropriate 
time interval. 

The network as described is not strictly a Hopfield 
network, however, because the linear transfer function does 
not accurately model the response of a neuron. In Hopfield’s 
formulation [Ref. 6] the transfer function which converts the 
output of each neuron is more accurately represented by the 
non-linear sigmoid function in Equation (14) where A is the 
learning rate and is positive but less than one. The plot of 
this sigmoid function, Figure 3, shows its relationship Pome 
ideal step change from zero to one. 

The Sigmoid function is the basis for the next set of 
experiments which were conducted with the test case used 
previously. Initially, all parameters remained the same as for 
the linear network. Additional parameters that needed 


consideration were the learning rate, A, and the sigmoid 
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PMimez Onan, Ge Prior to conducting the experiments it was 
not immediately apparent that G would be necessary, but its 
eventual incluSion proved critical and will be discussed 
further. 

Figures (10) and (11) are two plots of the sigmoid 
munetion which highlight the effect of varying A and G. It 
should be noted that in order to duplicate, and closely 
follow, the test case used in [Ref. 4], the form of the 


Sigmoid function was altered to 


g (8) 6 (2-2 (32) 


teemegute 10, 6 1s held constant at 1 while Ais varied from 
teineo 1s. The function converges asymptotically to +1 and -1 
Poreall A, but the slope of the linear portion of the function 
increases dramatically with increasing A. Figure 11 shows A 
bememse constant at 0.1 while G varies from 10 to 50. The 
asymptotes vary directly with G with an equally dramatic 
increase in slope as G increases. 

Initially, A was set at 0.1. As the necessity of G was not 
yet recognized, it was not included, effectively making G 
Segue to l..Figure 12 shows the results of this run, revealing 
meeemeecach of the coefficients in the system output vector, V, 
converges within the range +1 to -1. Experiments with various 


values for A, as well as expanding the time interval for 


Sie) 


Sigmoid Function as Lambda Increases from 0.01 to .1 


es 
© 
Uv 
a 
E 
© 
som 


eee ee ee | 





(1-((Nsepquie|—)dxa+])/z)=(n)s ‘aomMouny plomsis 


40 60 80 100 


z0 


=o) 


-40 


Sigmoid Function as A Increases From 0.01 to 0.1 


Figure 10. 


36 








o 
=) 
1 — 
i] 
I 
= I 
=) 
T ' ° 
© 7 oo) 
oO 
2 
= ° 
. J) 
° 
vo) 
fe) 
ba ° 
S <r 
— 
iS ° 
‘os ) 
w 
ce] 
wn 
fee] 
® 
re ° 
(3) 
= 
= 
O fo) 
E a) 
c | 
oOo 
Cc 
° 
o = 
t 
e 
O 
-— 
ee! 
O °O 
ro to) 
a { 
fx, 
ae) 
come ro) 
: = 
= 
Yn 
=) 
=) 
= °O °O oO °O oO ro) oS S oS °O 7 
uD + a) ie — ~ at) ae) wD 
i | t 


(1-((Nsepqure[—)dxa+1)/Z).9=(N)F ‘uoroUNY ploursis 


U 


Sigmoid Function as Gain, G, Increases From 10 to 
Oe 


507 


Figure ll. 


oe 


Output of Network Using Sigmoid Function 





s}Ualoyjao) xIVeW g pue Y 


250 


200 


150 


100 


50 


wott 


Output of Network Using Sigmoid Function 


Figure 12. 


38 


integrating the network, proved fruitless in changing this 
Baeorrect A" solution." 

The reason for this failure to converge to the expected 
results with what was believed to be Hopfield’s original 
formulation became apparent once the network was analyzed 
Meehnematically with g(Q) included. This system formulation is 


as follows: 


ae. N 
—— =-Y'wW,.g(O) +1 (33) 
Gt 2. ay ‘ 
As t ~o, (dO,/dt) ~ 0, so 
N 
eng (O,) +1,=0 (34) 
j=1 
ana 
2 1 
g(Q,) => (Wi) I, (35) 
j=1 


Neee, however, that the right hand side of Equation (35) 
returns the steady state values of the system parameters while 
EPMiemreke Nand Side by definition must vary between -1 and +1. 
Thus, the output g(Q) is constrained to converge to these 
values. This response provided the clue that some gain 
contained within g(®), which would extend the range of the 
Sigmoid function to encompass the expected values of the 


system parameters, is required for the existence of a steady- 


state solution. 
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When devising a method to determine the proper values of 
G and A to use, it was decided to maintain the same unit value 
for the slope of the linear section of the transfer function. 
For unit slope, then, the dérivative with respect to Gare 


Equation (32) must equal one at © 0, or 


29D) = G12 (-1) (142%) (-he™) | (36) 
and 
G9 | gay = 1 = GL-2 (2)? (2) | (37) 
SO 
pe. 
1 =6(5) (38) 
and 
i? 
G 7 (39) 


A value of G=15 was chosen to encompass the largest of the 
expected values of the system parameters, resulting in 
A=0.133, so these values were incorporated into the Hopfieua 
network. Figure 13 shows various plots of the sigmoid function 
when unit slope is maintained according to Equation (39). 
Appendix C contains a listing of the new computer code 
incorporating the sigmoid transfer function for netwoie 
formulation. The main program,..called "“"neuZsig,” calicuma 
reformulated Hopfield network subroutine "hop2sig," and 


integrates the series of equations where V now equals g(0), 
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the sigmoid function. As discussed previously, the system 
parameters are returned in V, not 0, so a plot of the elements 
of V, as the Euler integration proceeds, reveals the behavior 
of the network as time advances. Figure 14 is a plot of the 
separate elements of V normalized with respect to the 
individual, expected values of the system parameters, A and B, 
Showing their convergence within @,t=20. Figure 15 is a 
Similar plot, except that Vis plotted as a vector normalized 
with respect to the vector of expected system parameters. This 


plot shows convergence to within @t=15. 


D. REMARKS 

It has been shown that the Hopfield network algorithm can 
be used to identify the parameters of a simple, time- 
invariant, second-order system provided that the expected 
values of the parameters lie within the range of values of the 
non-linear transfer function used to convert the outpuaiew 
each neuron. The application of this method to real-world 
system identification is limited, however, by the necessity of 
having all states of the system fully meéasurabléey 4a 
realistic, and therefore more important, situation is one in 
which at least one system state is not observable, meaning 
this state must be estimated before the system parameters may 
be identified. The next chapter details the formulation of a 


Hopfield network for the current second-order test case, with 
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/ added complication that the state denoted x is not 


Surable. 
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IV. PARAMETER IDENTIFICATION USING STATE OBSERVERS 


A. INTRODUCTION 

The need for observers in modern control system design 
where one or more states can not be meaSured hasS Wseeeq 
thoroughly explored and documented. The original test case as 
previously used is now adapted to the exploration of state 
observation applied to the Hopfield network algorithm. 
Although the full states have been generated previously and 
are known, this Chapter examines the case where only the state 
variable x, is measurable, while x, must be estimated. This 
estimated variable, denoted &,, will be used with an esPimiaa 


~ 


variable ae formulate W and I. Finally, it will be 
determined if the Hopfield network will correctly identify the 


original system parameters under these conditions. 


B. FULL-STATE OBSERVER 

For the exploration of this problem, the computer code 
developed originally was left largely intact. However, the 
Subroutine "system," used previously to generate a time 
history of the state variables, has been replaced with a 
Subroutine called "observer" which contains the code necessary 


“~ 


to create a time history of the estimated variables xX andiiae 
Appendix D contains the pertinent computer routines for this 


problem. Note that in the code & and &, are contained in the 
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Mayjeers i xhae,” wWiile- tne time derivatives x’ and-~2.— are 
G@umainec in “xhatact ." 
Subroutine "observer" now contains a system of four first- 


Omuder ODE’ Sot the following form: 


_ [| = (Al + [BJ tu} 
2, A, (40) 
ae eS x 
= (A,-KC,]]_ {+ [B,]1 u}+ [KC,] 
& = Ey 


2 


The matrices A, and B, are the observer system parameters which 
initially are set as exactly equal to the actual system 
parameters A and B in Equation (27). The matrix C, is the 
SUEPUL Matrix, which in this case is [0 1]. The purpose of 
this "perfect estimation" of the actual system parameters is 
to see if the Hopfield network can correctly identify the 
actual system parameters based on State variable data produced 
by eStimation. System identification through the use of an 
observer when the actual system parameters can not be 
accurately determined will be explored later in this chapter. 
The feedback gain matrix K, which is the key to minimizing 
the error between the actual and estimated states, is found 
temnig the dual form of the linear~ quadratic regulator 
Subroutine "lqr" provided by the MATLAB software. This 
Subroutine returns the optimal value of K such that the 


feedback law 
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u = -Kx (41) 


minimizes the cost function 
J = [ (x/Qx+u/Ru) dt (42) 


For purposes of this solution 90 was chosen to be an identity 
matrix and the control weight R=.01, constrained by the state 


equation 
xX =Ax+Bu (43) 


The main program for this new problem formulation is 
essentially the same as for the fully measurable system but 
was renamed "neuobs." For the sigmoid function A=0.1 and G=20, 
which were found to give slightly faster convergence of the 
solution to the expected values. The major difference in this 
Main program is that W and I are calculated using 2 7 (237 
ee As before, the final solution is returned in the elements 
of the vector V. 

Figure 16 shows the convergence of the elements of V to 
the expected values of the actual system parameters. The speed 
of convergence is essentially unchanged from that of the 
previous system where all states were measurable, as shown by 
the convergence of all within the non-dimensional time value 
@,t=20. Figure 17 shows the normalized vector ||V||; again, 


the convergence rate is very close to that of the fully 


measurable system. 
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Normalized Output Vector for Full-State Observer 
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Figure 17. Normalized Output Vector for Full-State Observer 


a0 


The next step in exploring the observer problem was to 
determine if the parameters of the system could be 
successfully identified for that case where the actual system 
parameters were not accurately known. For this phase of the 
problem the following observer matrices were chosen as initial 
estimates which differ substantially from the actual 
Parameters of the test case: 


Ba ed > z -|?-48 (44) 
o}-10.0 -.7 oes 


Figure 18 is a plot of the resulting solution vector, V, where 
each element has been normalized over the expected value of 
its corresponding system parameter, and it shows that the 
network does not converge to the expected values of the actual 
system parameters. Table II shows the actual values of the 
system parameters, the values of the imperfectly estimated 
system parameters, and the steady-state solution of the 
network using the observer. It can be seen that the steady- 
State of the network returns something close to the value of 
the estimated parameter for V,,(3) but all other values differ 
Substantially from either the estimated or actual system 
parameters. Since this data is inconclusive, Figure 19 was 
generated which is a plot of the actual and estimated system 
State responses. This plot shows that the estimation of x, and 
me oegins to deteriorate rapidly at about t=0.7 and becomes so 


severe that it may indicate the presence of instability in the 
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Figure 18. Normalized Solution When Parameters Imperfectly 
Estimated, Full State 
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Figure 19. Actual and Estimated System Response, Full State 
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TABLE II. COMPARISON BETWEEN ACTUAL SYSTEM PARAMETERS 
AND SOLUTION USING FULL-STATE OBSERVER 
ee Rl a Ee IT Aa 


A, B A,, B, V.; 
= 07,9425 =O. TOO => Lol aGe 
LZ eesioo) HORC000 IS 78 216,58) 
$= lL 225600 = 10210 COD cal tA( 1 8) eS 2 
=e Sao? SO eeere 0) Opes cou 
1.0000 2.4400 Peete ALS 
ZV 00 1.3200 ie Oa 


observer. The inability of this system to produce an accurate 


estimation of the system response, which leads to inaccurate 
identification of system parameters, reveals the need for 
additional study into a method for minimizing the estimation 
error of the system response before formulation of the weight 
and bias matrices. Such a study was not conducted for this 
thesis but is deemed essential before implementation of a 


Hopfield network in a real-world application. 


C. REDUCED-ORDER OBSERVER 
The previous section dealt with the full-state observer 


applied to the Hopfield network, where the estimation of the 


entire state was returned if even one state variable “mee 


multi-variable system was not measurable. As noted in 


Friedland [Ref. 14], however, it was desirable to formulate an 


observer which need only return estimation of those state 


variables not actually measured while omitting the need to 
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estimate variables already known. A reduced-order observer was 
“sed fOr this purpose of Ccréating a time history of the state 
variables for the Hopfield network test case. 

Friedland presents two methods of formulating the reduced- 
order observer depending on the nature of the eigenvalues of 
the submatrix A,.. For the first method, the eigenvalues of A,, 
must be known to be negative, or that the real parts of the 
poles of this submatrix lie in the left half-plane 
Stir perent ly tar from zero to ensure Stability of the system. 
In this case, the equation to estimate the unmeasured 


Variables is quite straight-forward and takes the form 


2 =A,CUy +A,.3, + Bou. sa 
However, when the eigenvalues of A,, are not known or if A,, is 
Not stable, Friedland presents a more general method to 
estimate the unmeasured states. This second method was not 
needed for the test case examined in this thesis and it is not 
anticipated to be necessary for application to NPS AUV II, so 
its formulation has not been developed here. 

Appendix E shows the computer code for the chosen observer 
method. The modified subroutine "observer" contains a system 
of three first-order ODE’s consisting of Equations (28) and 
(45) adapted to estimate &,. The main program "neuobs" selects 
Peed 2, retricves x, and z, from the. Subreouc Ine “ODserver 


and uses them in formulating W and I. From there the network 
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algorithm continues as before. Figure 20 shows the individual 
elements of V as they converge to the expected values of the 
system parameters with a speed comparable to that of the fully 


measurable system. 


As with the full-state observer, experiments were 
conducted where the system parameters were imperfectly 
estimated as being those from Equation (44). Figure 21 shows 


that once again, the network solution converges to values 


Substantially different from the actual system parameters as 
shown by the comparison in Table III. For the situation where 
x, 1S meaSurable but x, is estimated, the steady-state solution 


of the network converges to the imperfectly estimated 


parameter values A,(1,1), A,(1,2), and B,(1). For the ween 


three solution vector elements, convergence to some values 


close to neither the actual nor estimated parameter values has 


TABLE III. COMPARISON BETWEEN ACTUAL PARAMETERS AND 


SOLUTION FOR REDUCED-ORDER OBSERVER 
Ss Le ee ee 


A, B i ee V.. 

- 0.9425 - 0.7000 - 0.7000 
12.5660 10.0000 10.0000 
-12.5660  -10.0000 -14.5529 
- 0.9425 - 0.7000 - 1.5149 
1.0000 2.4400 2.4400 
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Normalized Solution Vector for Reduced—-Order Observer 
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Figure 20. Normalized Solution Vector for Reduced-Order 
Observer 
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resulted. Figure 22 is a plot of the system response for the 
observer network and it shows that the eStimation of x. is not 
very accurate following t=0.2. Again, this may indicate 
instability in the observer system and, at least, requires an 
additional algorithm to minimize the estimation error before 


formulating W and I. 


D. REMARKS 

In this chapter the use of full-sState and reduced-order 
observers has been explored for use with the Hopfield network 
for cases where the states of a system can not be fully 
measured and, therefore, the weight and bias matrices, W and 
I, can not be formulated based on actual system states. The 
need for a means of estimating certain state responses before 
implementing the control laws for the NPS AUV has become 
apparent early in it’s design. When the surface dynamics of 
the vehicle are considered, it is found that two of the 
necessary system states, yaw rate r and heading angle W, can 
be eaSily measured with onboard sensors. However, the more 
Subtle system state called side slip v, is not so easily 
measured. For this situation it 1S desired to adapt an 
observer which will estimate v with an acceptable degree of 
feeueacy,. AS SHOWN In this report, however, -an accurate 
observer can not be developed unless there is full knowledge 
of the vehicle’s system parameters, which are not now known 


and will most certainly be variable in the course of vehicle 
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operation. Since the purpose of this adaptation of the 
Hopfield network is for identification of the system 


parameters, clearly the use of an observer will be 


problematic. 


oul 


V. TRACKING OF VARYING SYSTEM PARAMETERS 


A. INTRODUCTION 

An important situation to pursue in the study of system 
parameter identification is that of tracking and correc 
identifying system parameters as they vary during system 
operation. Applied to the case of the NPS AUV II, such a 
Situation may arise when one of the vehicle’s control surfaces 
is lost or damaged. In this case, the dynamics of the vehicle 
would certainly change and, in order for the vehicle to 
continue to operate, the mission controller would have to 
compensate for these alterations and continue to function as 
specified. To do so, however, it must have the capability to 
accurately track the parameter variations in a timely manner. 

In this chapter, the ability of the Hopfield network to 
track and identify such varying parameters is explored. For 
experimentation the test case in modified form is used where 
all states are assumed to be fully measurable. Simple step 
changes are imposed on one of the gain parameters, in this 


case [B(1)], and the results are plotted and examined. 


B. RESULTS 
Appendix F contains the code for tracking this system 
parameter. Subroutine "system" shows step changes implemented 


as simple "IF-THEN" statements, where [B(1)] varies once each 
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second from t=0.0 to 5.0. As before, the system response in 
terms of itsS state variables iS produced using the MATLAB 
Meeegrat1on Subroutine “odeZ3." 

The main program "neuobsi" divides the time history into 
one-second intervals corresponding to the step changes, then 
reads the state variable values over those intervals. The 
State variables are used to formulate intermediate W and I 
matrices, averaged over the number of time steps within each 
interval, and the Hopfield network’s system of ODE’s is 
integrated using Subroutine "hopobs" to produce a network 
solution corresponding to that interval of time. Once all 
intermediate network solutions have been generated, they are 
assembled into a global solution covering the entire five- 
second time period. Figure 23 shows a plot of [V(S)], wWoyen 1s 
the element of the network solution which tracks the parameter 
of interest. Overlaid on the plot is the actual variation of 
[B(1)], which allows the speed and accuracy of the convergence 
of the solution to be examined. The figure shows that for the 
first three seconds of time, the solution tracks the parameter 
values after converging within @t=50. This speed of 
convergence is much slower than for the case when the 
parameters remain constant, which for all experiments was on 
the order of @,t=20. 

Most importantly for this network solution, it can be seen 
'MaOomene Fequre that during §the fourth, ~one-second ~time 


interval the error in the tracking element iS unacceptably 
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Tracking of Varying Gain Parameter [B(1)] 
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Figure 23. Tracking of Varying Gain Parameter [B(1)] 
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large and, in fact, the network has not achieved convergence 
teomeany Value “within @.C=200. “Following this. discrepancy, 
during the fifth time interval, the speed of convergence and 
Feeulracy Oe tine SOlULIOnN return to that noted for the first 
three time intervals. The behavior of the solution during the 
fourth time interval presents a serious lapse in the 
Pe“fo Malice so. Line meework and must be Studied more closely, 

The data for this network solution is presented in Tables 
IV and V in order that the performance of the network during 
the fourth time interval may be more closely studied. The 
eigenvalues of the weight matrix W shown in Table IV reveal 
that for the fourth time interval, two pairs of poles are 
extremely close to zero relative to the other pair and to the 
pairs of poles for the other time intervals. In addition, the 
Small error found in the solutions for the other time 
MeCuvalS 1S also a product of lack of sufficient excitation. 
For the parameter tracking problem it was difficult to ensure 
that W would be averaged over the correct number of time steps 
because the subroutine "ode23" is a variable-time-interval 
integrator. This problem was not fully explored but should be 
a subject to pursue in future research involving parameter 
Gracki ng. 

Table V shows that the steady-state solution for the 
network element [V(5)] in the fourth time interval is equal to 
We 4oo whitch 1s mot at all close to the expected value for 


[B(1)] of 0.5. The reason behind this isolated discrepancy in 
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TABLE IV. EIGENVALUES OF W WHILE TRACKING [B(1) ] 


TIME EIGENVALUE PAIRS 
INTERVAL 
eo = alee) ~4024 .59014 22679 
10 = 270 leery ~0902. ~ 1 alOay 
ZO. Oa .0475 Be 210s 
32.0 = 47.0 .0035 .0025 -2478 
ore Oe 0292 020i | Oss 


TABLE V. STEADY STATE VALUES OF V (V,, = W°*I’) 
: 


ae Oras 12.5960" = 1275660 39425" ea 
me EZ a age 1) 2) 72 -12.5660 —-.9425 5.1165 2508s 
= 5 95 In LZ DOD 12 OO 0. ae 42S 9.9439 “2, 00m 
Spee as 13.5320 -12.5660 “=. 9425" "0.1458" 23 
Se spaced aes Ls Gols Sume™ mel Pvp oiG Oily —4..1.66 1.20 Bi 


9425 


network performance lies in the fact that during the time 


interval in question, the gain parameter being tracked lies 


close to zero. During this period, the system is not being 


persistently excited to the extent necessary for the 


formulation of an appropriate W, which instead tends toward 


Singularity. In this case, the network can not be expected to 


converge to the proper solution. An attempt was made to 


examine an alternate method of integrating the system to 


produce the state response. Instead of the variable-time- 


interval: Runga-Kutta algorithm of “ode23" the system was 


integrated using a linear, time-invariant, time-response 


algorithm with the system converted to discrete form. This 
method did not produce results substantially different than 
those shown in Tables IV and V. 

It can be seen that in order for this network formulation 
to be used successfully under conditions of varying system 
parameters some adjustment in the software must be designed to 
guard against insufficient excitation by the system. It is 
apparent that test signals need to be defined to ensure 
Siero be =CONGIELIONing of Ws A Set. of persistently exciting 
input functions could be stored which would be designed to 
maximize the singular values of W, which could be called by 
the vehicle’s mission planner in order to optimally "test" the 


Vietmrcle’ Ss behavior. 
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VI. SUMMARY AND CONCLUSION 


A. SUMMARY 

At the center of the Naval Postgraduate School’s project 
to produce an Autonomous Underwater Vehicle (NPS AUV II) is 
the Mission Planning Expert System (MPES), a hierarchical 
system to control all operations of the vehicle while 
executing its planned mission. An important part of 
implementing such an expert system 1S mapping and successfully 
incorporating knowledge of the vehicle dynamics into a 
comprehensive vehicle control algorithm. One way of achieving 
this goal is through the application of Artificial ema 
Networks (ANN) to identification of the state-space form of 
the vehicle’s system parameters. 

This thesis has focused on the application of the 
continuous form of the Hopfield network to system parameter 
identification. In its original form [Ref. 5], H@~meaeme 
presented his network as a discrete-time model of a set of 
biological neurons, each of which computes the weighted sum of 
the outputs of all other neurons, including its own, then sets 
the output to zero or one depending on whether it is above or 
below a set threshold value. In a subsequent paper [Ref. 6], 
he presented a continuous form of the model based on the 


operation of an electrical RC circuit. In that model, Game 
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mematlom Deeween Ene OULPUL Of a neuron, termed its State, and 
the weighted sum of its inputs plus a bias value, was 
characterized by the non-linear sigmoid function, which he 
felt bears a Superficial resemblance to the manner in which a 
biological neuron changes states. 

For both models Hopfield sought to prove the network would 
a€always converge to a unique set of outputs based on a distinct 
pattern of inputs. To do this he likened the network to a 
bounded energy function which, as each neuron changes state, 
is monotonically decreasing and eventually seeks a minimum 
value. 

Shoureshi and Chu used this idea of the minimization of an 
energy function while studying the problem of dynamic system 
parameter identification. Their work forms the basis of this 
thesis, which is a detailed study of the Hopfield network for 
parameter identification with a view toward implementing it 
iam@es the Control system of NPS AUV II. A ilinear, time- 
invariant system was chosen as a test case to see if the 
outputs of a Hopfield network would converge to the known 
system parameters, given that the weight and bias matrices, W 
and I, are formulated from the system response as_ shown 
herein. As the stability of the network in this form was also 
Sreemajor Concern and not directly inferable from the Hopfield 
Pecotmity PrO0l, a proof of stability was completed and 1s 
contained in Appendix A. Numerical experiments were conducted 


first with the system states fully measurable, then with the 


og 


incorporation of observers to estimate one state variable, and 


finally assuming the states were fully measurable but one 


parameter was varying with time. 


B: 


CONCLUSION 


It has been show that 


Hopfield networks can solve function minimization 
quickly in real time and, in particular, can perio 
system parameter identification. 


The formulation of the weight matrix W was not possible 
for each individual time step because the matrix was at 
first singular, meaning that the steady-state value of 
the system, which involves the inverse of W, did not 
exist. By examining the eigenvalues of W for each time 
step it was determined that acceptable performance was 
obtained when the state response, used to formulate W, 
was first averaged over 50 time steps. 


Integration of the network following formulation of the 
W and I matrices revealed that the outputs did converge 
to the actual values of the system parameters. 
Convergence was speeded up to within 2 cycles of the 
natural frequency by introducing a scale factor of 50 
to multiply W and I. 


For the network to identify the actual system 
parameters, the range of the non-linear sigmoid 
function must encompass the parameters’ expected 
values. 


Imperfect estimation of parameter matrices when using 
full-state and reduced-order observers produced 
unacceptable system-State estimation error which led to 
incorrect formulations of W and I and inaccurate 
network solutions. 


The network exhibited an acceptable ability to track 
significant changes in system parameters ds jeame 
progressed. When the varying gain parameter [B (1) ] 
dropped to a value close to zero, however, the system 
was not being persistently excited and the solution 
performance degraded drastically. Inaccuracies in 
tracking over all time intervals pointed out Che neee 
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for persistent excitation by the test signal to ensure 
that W is well-conditioned. 


C. RECOMMENDATIONS 
The following topics are presented for possible future 


research: 


as. The number of time steps in the response of the system 
over which to average W and I should be optimized to 
minimize the network solution time. 


2 A routine should be included with the sigmoid function 
to ensure that its range will always encompass the 
expected values of the system parameters without being 
excessively large. 


ce Performance of the network should be investigated when 
the system input signal contains random noise. 


4. The value of the gain S1 should be optimized to ensure 
maximum speed of convergence of the network solution. 


or Additional experimentation with Hopfield networks and 
observers should be conducted including routines to 
minimize the error in system state estimation. 


Oi, Practical issues in test signal amplitude and frequency 
content need to be addressed to ensure the appropriate 
Coneieron 2of WwW. 


ae Hopfield networks should be implemented for 


identification of the actual operating parameters of 
Nes 2AUYy itt. 


Fost 


APPENDIX A 
PROOF OF STABILITY OF THE HOPFIELD NETWORK 
FOR PARAMETER IDENTIFICATION 


In the system identification problem, the estimation of 
erroneous parameters leads to an equation error of the kind, 


@,(t) =H (G)V soot ee eee 


in which the system model and the parameter vector so formed 
are obtained as follows. 


System equation: x(t) =Ax(t) +Bu(l) |7yvlb exe) 


Parameter vector definition: 
Vi (tt) = [2c yd Bie le ener oe 


where a, and b. are the i row of the system parameter 


matrices, A and B. If the measurement matrix H(t), is defined 


as, 
x’ (tome ) 0 eee 
H(t) =| <..0..0° x’ (E)ul (tl) | 0 eee 
AOE & Ss ee x (t)u te) 


this beads 76 


x(t) =H(t)V(t) +te(t) 


in which the errors e(t) account for measurement noise and 
errors due to parameter mismatch. 


Definition of a positive definite averaged error squared 
energy function, J, leads to 


UZ 


z=ay fe, (t)e;(t) ) 
5=1 
and in terms of the parameter set V(t), 
J=Atl H(C)V(E) -X(t) ] 1 A(t) V(t) -x(t) )) 
SUL ab gle) 
Meee (Cc) AIH (Lt) ]H(C)V (LE) -2V’ (e)A [ HE)’ (Lt) ] tA LX (Ee) x (eZ) ) 
Since J iS a positive definite function of V(t), convergence 


of parameters to a stable set in which J is minimum is 
guaranteed if its time derivative is negative. 


The required stability condition is then, 


dle Oe (t)V(t)<0 V vit), t= [0,0] 


dt dV 


Puen a condition is met if, 


V=-sgn ee 


The Hopfield network can be shown to meet that condition 


Since, 
“OV 
Or, 
Sdn 
i eal 


where, W=A[H’(t)H(t)] , and T=A([(#8’ (t)x(t) ] 


Defining Wit) =-2 teads to “Ehe Wsvymaptrie eCxecriarion 


equation of Hopfield, 


iS 


SO = -W +I with V=g(O) 


g(Q) is always increasing as (©) increases (i.e. g(Q) lies in 
do 
‘at 


with g’ (QO) always positive. The result demonstrates that J 


the lst - 3rd quadrant in the 9 - V plane), then V=g’ (©) 


will seek a minimum as 


OJ 


ay (ts 


Vit) =-g/ (O(t)) 
which meets the stability condition shown. 
REALIZATION OF THE SOLUTION 
In spite of the above, convergence of dO/dt to 0 as t 
progresses does not always lead to convergence of V(t) to the 
correct parameters, and one additional condition is necessary 


to impose. 


Assume that 0, [-~°,0] and define, 


Gnaxzltim g(Q) as © «0 and g,,,=lim g(Q) as © 4-6 


Define V,, as the steady-state solution of V(t) as t become 
large. 


Define 0,, as the steady-state solution of O(t) as t becomes 
large. 


lt £G6lMows that unmbecs 
Onin < Vie = Omax 


a steady state solution for V does not exist. The point is 
illustrated in Figure Al. 
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BU outside the range of g 


@ "se “ee ‘oe Ce Se “a “eo “a “eo “o ge a's ‘ee “« ‘e's ‘eo “oe ‘eo ‘we oe “eo + “eo & 
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VIALLLTEEETAIRATTLAAT AAT ATA 


Figure Al. Range of g, U=0 
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APPENDIX B 
MAIN PROGRAM FOR HOPFIELD NETWORK 
WITH LINEAR ACTIVATION FUNCTION 


Main Program for Hopfield network with linear activation 
LuUNnCciaeem 


oP oO 


oe 


program neu 


toO=0 7 see ee le |e 

[tnew, xnew] =ode23 ('system’,to,tf, xo); 
nl=50; 

t=tnew(l:nl); 

X= Some wo Glen 17: jae 


form I—=—12) 
[ff)=system(t(2) pei, 2); bil) tt ere, 
U=Sint(t). £=t/al- 


r= ey 7 ee 
Re ee) ee) 
xl Sse) eee ae 
SSG) ey alee 
R23 ee ee 

uu=u *a/nl; 


ie} 


% Calculate average values for weight and bias matrices 


W=zeros (6,6); I=zeros(1,6); 

W{l,l)=xe1l; WL, 2) =xx123 Wil 5) Hae Wi 

Wz, 1) Hn le W272) =yx2- Wess ) Sol W(3,4)=W(1,2); 
WS; 6) =e, 

W(4,3)=W(2,1); W(4,4)=W(2,2); W(4, 6) =xX2u; W(5,1)=W(1,5); 
WS) ZY =WiZ eS) 

W(5,5)=uu; W(6,6)=uu; W(6,3)=W(3, 6); W(6, 4) =Wi4, 6); 
T(l)=x(2,1)'*f(:,1)7 L(2)=x(7 2) 8 (27 1) 1) = eee 
1(4) =x Gig.2) "AE (252) 4.61 (5) =U ae eG eee 


Perform Buler integration on the Hopfield network 
aul Gigi item 


of oP 


dt=.02;~i1nt=100>.si=56- 
tho=ones (1,6); 
Wee es a igies: 
[Eneece | =hop (yl thio-,sl 
Bh=eheGe+Oetune.- 
Sho=th’ 7 chp iia) — tae. 
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end; 
meeta—|—-2.94248/12.566 =12.566 —.94248 1 2); 
thvec=sqrt (theta*theta’); 
moe en —)<100-> 

EVyec(i)—at i 

ee Gnely) =o Cee tt ( 12, 6.) = thd. (i yte) ) 
end; 
we=sqrik (.94248°2+12.566°2) ; 
pion (wo *tvec, thplvec/thvec) ; 


% Subroutine containing Hopfield algorithm 


2) 


6 Pleogran AOp 
Pomerelon{tndot }=hnop (WwW, I,th,sl) 


ieee w= 1 2°6 
Pat hh (iL).5 
end; 


Peo (Ce). V3) V4) V5) V6) ]¢: 
thdot=-sl*w*V+sl*I’ ; 


% Subroutine containing state-space formulation of test case 


2) 


6 program system 
function[f]=system (t,x) 


= salen GL ) 

Pao 4746 12.566; -12.566 —.942481; B=l1; 2]; 
leds) =e ) tA (1 2) Ax (2) +B (1); 

ieee be 1) tPA (Z, 2) *x (2) 4B (2) *U; 

f=[f1 f2]; 


a) 


APPENDIX C 
MAIN PROGRAM FOR HOPFIELD NETWORK 
WITH SIGMOID ACTIVATION FUNCTION 


Main Program for Hopfield network with sigmoid activation 
FUunEe hea 


ae o\° 


oe 


program neu2sig 


to=0; tt=l- %xo=-—( 1), 1/7 

[tnew, xnew]=ode23(’system’,to,tf, xo); 
n1=50; 

t=tnew(l:inl); 

x=xnew(l:nl,:); 


for i=l:nl 
[ff] =system(t (1), x (4,2) fe) HE Beene 
vu=Sin(t); f=f/nl1; 


KM ee ale 
RZ xe) a 
MOC 30s ge ays, 
Si eel a 

a = ee ee ia 

uu=u’ *u/nl; 


% Calculate average values for weight and bias matrices 


W=zeros(6,6); I=zeros(1,6); 

W(l,1)=xxl; W(1,2)=xx127 WO) 3) = 
W(2,1)=W(1,2); W(2,2) =xx2; W375) =xe- W(3,4) =W ee 
W(3,6)=W(1,5); 

W(4,3)=W(2,1); W(4,4)=W(2,2); W(4,6)=x2u; W(5,1)=W(1,5); 
WiCS, 2) =W CZ) a; 

W(5,5)=uu; W(6,6)=uu; W(6,3)=W(3,6);7 Wo, 4) -W(4, 5); 
T(l)=x(¢,1)’*E(:,1)7 142x724) iG) 13) = 
1 (4) =3425-2)"*£(3,2)7 13) -o fC te eee 


Perform Buler integration, om eEnestoprlela Nervomn. 
algorithm. 


cP ol? 


dt=.02; int=100; sl=50; lmda=0.1; G=20; 
tho=ones (1, 6); 
fOr t>2. mie; 
fthdet, Vl =neseZzstGg iw, leno, slj mda, SG); 
Eh=ERdOL Otte 


zs) 


Che—-th-; thpl(a,:)=—the; tvec(i)=dt*i; 


Veli) — ee SS (ees) = Ay (Wes Ee 
end; 
eieta—|-.94248 12.566 —12.566 =.94248 1 2); 
thvec=sqrt (theta*theta’ ); 
tone: 6; 
Ppt) —Vipi(s 1) /tneta (1); 


end; 
wemsarut. 94248°2+12.566°2) ; 
Meee iwo*Evec, VVpl) > 


% Subroutine containing Hopfield algorithm 


ie) 


% program hop2sig 
Pumet Loni thdaot, V)/=nop2sig(W,1,th,sl,ilmda,G) 


Eo w=. 6 
Po 47 / (exo (—lmda*~thi(1)) y-L); 
end; 


ey (2) V3) V4) VCS) Vv (6) )¢; 
thdot=-sl*w*Vtsl*I’ ; 


% Subroutine containing state-space formulation of test case 


° 


% program system 
fumeeion! f£l=system(t,x) 


u=sin(t); 

A=[-.94248 12.566;-12.566 -.94248]; B=[1;2]; 
ede asta Ce es Ol Aa Mates OA) ee wd wn Olas ca 

pa by ey tA (2, 2) x (2) +B CZ) *u; 

1c |r eae. 


a2 


APPENDIX D 
MAIN PROGRAM FOR HOPFIELD NETWORK 
WITH SIGMOID ACTIVATION FUNCTION 
AND FULL-STATE OBSERVER 


Main Program for Hopfield network with sigmoid activation 
function and full-state observer 


AP oP 


program neuobs 
Development of state variable time history 


oP ol? 


to=H=0; “tr=le xo=liy 1 1 Lie 

[tnew, xnew] =ode23 (’observer’,to,tf£, xo); 
n1=50; 

t=tnew(l:nl); 

X=xnew ( emi. .) s 


fOr aie nid 
[££ \=observera Ga )- x1, 2) ie tt, eH ee een, 
U=San Ge) = rele eae 


ee 


Re = en se ey 
se — se 12 Fees Ae oles 
lee a Sie 


Pere eso iy nik 
vu=u’ *u/nl; 


% Calculate average values for weight and bias matrices 


i io I=zeros (1,6); 


W(d, lJ =Rex1; Wi1,2)H=2212) Wes) =e Ws 

W(2, eee ee: Wi(27 2) =x x2 W333) =x; W(3,4) =W( eae 
WG 6) =—Wil 5); 

W(4, oy ates ie W(4,4)=W (2-2). W(4,. G)=x2; W(5,1)=W( Se 
WS) 2) =" (Z- re 

a S., 5) =uu; W(6,6)=uu; W(6, 3) =W(3,6); W(6,4)=W(4, 6); 

T(l)=2 (3,1) *£(2:,1) - T2027 2 Ee ss) x eee 
T (4y=x 2, 2) 28 (2,2) 1 aa eee ee 

% Perform Euler integration on the Hopfield network 

% alLGonrawim, 


dt=.02 25m 00 3s = 5.00 ele Cee = er 
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tao—zeros (1,6) 
fOr vi —2 Mt 
PEM@eEe yi —=NOpcbo(iW i, tno, Sit, lmda,G) ; 
EN—-EMOot- oL+ehe 
eheo=el = sthol (int )=tho; tvec( 1) =dt*i; 
Vous =v omencs(2. >) =-inviaewiel” ) 
end; 
mipewma— (=. 04748 17-5606 —12.566 —. 94248 1.2); 
thvec=sqrt (theta*theta’); 
Pore —i* 6; 
Wola) =Vpl (71) 7 theta (1); 
eng; 
Weer (294 745°7+12.566°2); ploe(wo*tvec, VVpL); 


% Subroutine containing Hopfield algorithm 
% program hopobs 
PUMeeLom!|chaet,V)/=hopobs (W, 1,th, sli, lmda,G) 
for 1=1:6 

Wiv=G~(7/(l+exp(—Imda*th(1)))—1); 
end; 


Peele Vy tZ)7 Vv (3) Via) eV (5) Vie) 1"; 
gee sl *WtVtSI* 1’ ; 


Subroutine containing state-space formulation of test case 
and full-state observer 


oP oO 


% program observer 

fuUmeri1on( ft |—observer (t,x) 

le ool i, ) 

Pet 24248 12.566;-12.566 —.94246); B=l[1;2]; C=(0 1]; 
Poe O10 —. 71>; Bo=(2.44;7;1.39)]; Co=(0 1); 

% Ao=A; BO=B; 

O=eye (2); R=.01; 

pee el 2) ee Katee (324) 7S 

Bees | =loxr (Ao, Bo, 0) RR); 


XXQOTC=A*xXxX+B*u; 
Paacaotc—(Ao—-K’ *Co) *xhat+Bo*ut+K’ *Co*xx; 


p— | x<XCOn” “x<martdot” | ; 
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APPENDIX E 
MAIN PROGRAM FOR HOPFIELD NETWORK 
WITH SIGMOID ACTIVATION FUNCTION 
AND REDUCED-ORDER OBSERVER 


Main Program for Hopfield network with sigmoid activation 
function and reduced-order observer 


ae oe 


program neuobs 
Development of state variable time history 


of a\° 


bO=0> “tr=l xo= (1 aie 
[tnew, xnew] =ode23 (’observer’,to,tf, xo); 
ig yle— a0) 
t=tnew(l:nl); 
Xx=xnew(l:nl,:); 
for i=l:nl 
[EL] =epserver (te (a) Go): 
£ (a, I= fis he) eee 
end; 
Soe ce ei ie 


sx a ee * i oee 
Meza Cle) es (7 eee 
SZ ss ok GC Zea 
SUS x eo) ee 

KZ = ss 7 ae tele 

uu=u’ *u/nl; 


0 


% Calculate average values for weight and bias matrices 


W=zeros(6,6); I=zeros(1,6); 

W(1,1)=xxl; Wi1,2)=xe12- Wl 5) = ea Sc - 
W(2,1)=W(1,2); WD, ZV & "(37 39x W(3,4)=W(1, 2); 
Whee. 6) —ViGleoa.: 

W(4,3)=W(2,1); W(4,4) =W(Z2, 2); (4,6) =xZu> W(5,1) =W (1 fee 
Wika 2) —Wies oo 

W(5,5)=uu; W(6,6)=uu; W(6,3)=W(3,6);7 W(6, 4) =W(4, 6); 
D(lj=x(:,1)'*8(:,1)¢ LiZj=x(:, 2)" *t a 2 eee 
LC4)=xtip 2)" E (2, 2) De ae aoe 


Perform Euler integration on the Hopfield network 
algorithm. 


ae o\0 


dt=.02> imr=100; “sl=50- eimda=0e Ga 7 Cr 
the=Zeres{( 1,6); 
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fOr a2 ants 
[thdot, V] =hopobs (W, 1,tho, sl, 1mda,G) ; 
EN=eE Maer -~Qe+t no; 
Biome; well (iss) tho, evec (1.)—=ct *1> 
Viet Vo SS (is) = (any (—W) Ay 
ena; 
mineta—(-.947246 12.566 =—12.566 —.94248 1} 2); 
thvec=sqrt (theta*theta’ ); 
fOr yl—13 6; 
VVC: 4 )=Voli: 71) theta (1) 5 end; 
Wee See 947246" 27 12.5660"° 2); plot (wo*tvec, VVpl); 


% Subroutine containing Hopfield algorithm 
% program hopobs 
PVi@en lon (thdot, V|/=hopobds (W,1,th,sl1,imda,G) 
foie w=). 2° 

Pe — Ga 2 / (exp (=lmda~th(1)) ) =); 
end; 


ieee ey C2) V3) V4) V5) V 16) )7; 
thdot=-sl*w*vV+sl*I’'; 


Submour ine Containing State-space formulation of test case 
and reduced-order observer 


oP oO 


oe 


program observer 

fum@ce1On|f)|=cobserver (t,x) 

i= Same at): 

Pe 94248 12 .566'-12.566 =. 94248); B=(lseZz]; C=(0 1]; 
Poa, 10s 10. —2 /)> Bo=(2.44°1-239)> -Co=([0 1)? 

6 AO=A; Bo=B; 

O=eye (1); R=.01; 

Moet eZ)’ xihat—x (3); 


Rm AeOL—A*xXxX+B*u> 
pmeat dot —Ao (ly 2) *x (2) +A0(1, 1) *xlhat+Bo (1) *u; 


E=leexdot”- xihatdot |; 


SO 


APPENDIX F 
MAIN PROGRAM FOR HOPFIELD NETWORK 
WITH SIGMOID ACTIVATION FUNCTION 
TRACKING VARIATION IN GAIN PARAMETER B(1) 


Main Program for Hopfield network with sigmoid activation 
function tracking variation in’ gain paramecer Em 


ae ole 


ae 


program neuobsl 


tO=0 + bee — lee 


for\ya—keo-e 
it a-—l co—) aaae— |y 
elseif a==2; to=1; tf=2; 
elseif a==3; to=2; tf=3; 
elseif a==4; to=3; tfr=4; 
elseif a==5; to=4; tf=5; 
end; 


lt, “l=0deZs:( SyStem , Gore, «eo 7, 
(rs = Si Zes(b exo — xe 


F Oia le sige 
[Ff] =system(e(i), x41, 2) 2 — emer 
u=Sin(t); f=f/n1; 


XS x (ele) ©. “ce le) k= 
pO a Ge ad Vadis <a ie 729 ey eile 
RR = a eee ce ia 
lb oa@s rally! obi sgtile 

X2ZU= (eee Oe le 
Vu=u" “1 ml 


.e)} 


% Calculate average values for weight and bias matrices 


W=zeros(6,6); I=zeros(1,6); 
W(l,1)=xxl; W(1,2)=xxl2; W175) =x a2 — 
W(2,1)=W(1,2); VWiOGZ 7a W (35.3 =e: W(3,4)=wWi Ree 


( 
W(3,6)=W(1,5); 
W(4,3)=W(2,1); W(4,4)=W(2,2); W(4,6)=x2u; W(5,1)=W(1,5); 
Wie See eee oe 
W(5,5)=uu; W(6,6)=uu; W(6,3)=W(3,6); W(6,4)=W(4, 6); 
T(l)sx(i,1)°*f(:,1)7 D(2)=x(2,2)"*t( jl) ee eee 
I (4) S803 2)" *£ 02,2) 1 (5) SG ea = ee 


% Perform Buler integration on the Hopfield network 
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% elke (openmelone 


ae=—02;5 iant=l000; sl=50; Imda=0.1; G=20; 
tho=ones (1,6); 
Bey l= | line 

fEncoe, | —nopeos(W,.., eno ysl, lmda,G); 

Elo ec letelo) seus clume s6e8 eae 

RG=pn | sehoOl 1 2) =pao- > Vol (132) =V" > ena; 
theta=[(-.94248 12.566 -12.566 -.94248 1 2]; 
Pmvec=sort (theta*theta’ ); 
We-eagre(.942438°2+12.566° 2); 
@vec—at~(1:5000)"> 


Garmin (2;a)=Vol(:,5); 

ie tet = 1555 
= LOO O* 1g; 
k= OO0* 19-999; 
Gee) Calnb{ 2,10); 


end; 

IMONe t= 000; BB(1)=1.03% -end; 
pemet—lOOls 2000; BB (1)=5.0;)- end; 
pomwi—=7001;3000;° BB(i)=10.0; end; 

mom oO0lb. 4000; BB(1)=0.5;. end; 

hemes —4 001-5000; BB (1)=-5:0; end; 

Plem we Cvec,BB,wo*tvec, gb) ; 

% Subroutine containing Hopfield algorithm 


% program hopobs 

POMe@El On| Ehdot,V)=noo(W,1,th,sl, lmda,G) 
Poms —126 

Pai —G {(7/ (l+ex0 (-lmda*th(i)))-1); 


end; 


a eee (2)e V3) V (4) Vid) Ve) I’; 
ENGOt=—sSl*W*V+sl*I’ ; 


Subroutine containing state-space formulation of test case 
with step changes in gain parameter B(1) 


of oP 


oe 


PLROOGamesy Seen 


hOMGe LON lt —svyetem (t; x) 
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sls ibene yy 


A=[-.94248 12. 


fem co — ie 
elseif t>=2. 
elseif t>=3. 
elseif t>=4. 


end; 


RRa= x (12 


XXGOtC=A*xXxX+B*u; 


£=xXxX@ot- 
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